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Abstract 

The primary objective of this project was to provide a more detailed description along with “real time” 
information to the community of educational administration preparation programs in the State of New 
Jersey as to what are considered to be the critical elements, skills and competencies current Chief School 
Administrators (CSA) in the state deem important when evaluating school building leaders. Additionally, 
the secondary objective was to determine the operational effectiveness of the ISLLC standards as they 
are understood and applied by New Jersey school superintendents. Using a quantitative survey design, 
the results of this descriptive study, based on a limited sample of suburban Chief School Administrators, 
suggest that, in general, suburban CSAs believe that student and staff safety, child advocacy, strategic 
planning, ethical behavior, collaboration, trust building, nurturing learning and instruction, sustaining 
high expectations, maintaining and sustaining family relationships and understanding the legal aspects 
of decision making are essential elements to be considered when developing summative evaluations for 
their district’s principals. 
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1 Introduction 

There does not appear to be much support in the literature for discussing and exploring the development 
of a comprehensive and reliable system of principal evaluation (Rosenberg, 2001; Catano & Stronge, 2006). 
Primarily, it seems that in most states, principals are more often than not evaluated based on their students’ 
success, or lack thereof, on the federally mandated and state implemented standardized tests (Ediger, 2002). 
This myopic view of a principal’s overall effectiveness as a leader not only seems limited and restricted but 
also shortsighted. Since so much has been written in the recent past on teacher evaluation and its impact 
on student achievement, a concerted effort that focuses on principal evaluation would be the next logical, 
evolutionary step in the discussion about improving schools. 

In a series of interviews with principals and superintendents concerning the evaluation process, Davis and 
Hensley (2000) reported that the formats and processes used in evaluation often vary from district to district. 
They also found that many principals did not find the evaluation process to be useful in forwarding their 
professional expertise and more often than not, were influenced by outside political forces. Both authors 
suggested a collaborative approach that not only identifies criteria but also defines the process. 

Amesterdam, Johnson, Monrad and Tonnsen (2005), in collaboration with a myriad of statewide stake¬ 
holders, successfully assisted with the development of a comprehensive system for principal evaluation for 
the State of South Carolina. Central to this discussion and collaboration were district leaders and current 
practicing principals. Critical to the development of this system was an agreed upon criteria, which evolved 
from actual practice and current State and National standards. 

The State of Illinois, in an effort to systemically address the issue of a consistent process of principal 
evaluation, passed legislation requiring the annual evaluation of one-year and multi-year contracted build¬ 
ing principals. Adherence to this new law is mandated and strictly enforced. This responsibility logically 
falls directly to the district’s chief school administrator. The evaluation process must specify the individ¬ 
ual’s weaknesses and strengths and is aligned to the state’s standards for school leaders (Dutton, Selbee 
& Schwartz, 2006). Similar work, although not necessarily legislated, is happening in many states across 
the country relying on both state and national leadership standards to establish baseline performance levels 
(Catano & Strong, 2006). 

What can be deduced from these previous reports is that an agreed upon criteria and procedures are 
needed and essential to the process and the development of a reliable and effective model of principal 
evaluation. Continued study and discussion on this topic is critical for every state, particularly at the school 
district level. Central to this ongoing discussion are the Interstate School Leaders Licensure Consortium 
(ISLLC) Standards (Council of Chief State School Officers, 1996), a set of comprehensive leadership standards 
that have been influencing public school leadership since 1996 (Van Meter & McMinn, 2001). These standards 
have recently been revised and updated to reflect a more practical, operational and functional, rather than 
theoretical, approach to local building leadership and are now labeled the Educational Leadership Policy 
Standards: ISLLC 2008 (Council of Chief State School Officers, 2007). 

A majority of university administrator preparation programs have developed their curricula on this set 
of national standards, commonly known as the ISLLC standards, in order to prepare their students for the 
business of leading schools and successfully passing individual state licensure exams (Ellett, 1999; Latham 
& Pearlman, 1999; Lindle, Stalion & Young, 2004; Murphy, 2002; Murphy, 2005; Murphy, Yff & Shipman, 
2000). If administrator preparation programs are going to continue to develop their curriculums based in 
and around these standards, then a better understanding of how these standards are actually applied to 
the summative evaluation process of building principals in the real world of public schools by chief school 
administrators is a necessity for these programs and their students (Barnet, 2004). 

The primary objective of this project was to provide a more detailed description, along with “real time” 
information to the community of New Jersey educational administration preparation programs, as to what 
are considered to be the critical elements, skills and competencies current Chief School Administrators in the 
State of New Jersey (NJ) believe to be important when constructing summative evaluations for their school 
district’s building principals. A secondary objective was to attempt to distinguish between what are the 
essential, as opposed to the important, leadership functions and job responsibilities of a building principal 
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as defined by the ISLLC standards and determined by New Jersey Chief School Administrators through the 
summative evaluation process. 

The original research question addressed was: Are certain ISLLC “functions” deemed more im¬ 
portant than others by New Jersey Chief School Administrators when developing a summative 
evaluation for their building principals? 

2 Methodology 

The Survey and Data Collection 

The research design for this study was descriptive in nature utilizing survey research as the primary 
data collection tool. The survey was developed using the Educational Leadership Policy Standards: ISLLC 
2008 (Council of Chief State School Officers, 2007) as the content model; specifically the “functions” for 
each standard. The ISLLC 2008 standards provide an operative content and language associated with what 
building principals need to know and do to be successful leaders (Latham & Pearlman, 1999). Survey content 
validity was obtained through expert review. 

The on-line survey consisted of two parts. Part A was a 66-item “forced response” multiple choice 
questionnaire that attempted to gauge New Jersey CSAs attitudes and perceptions to what is important to 
consider when developing a summative evaluation for his school district’s building principals. 

Each of the corresponding ISLLC 2008 Standards’ functions was used as the basis for item construction. 
When an ISLLC function identified several variables within the text, a separate item was constructed for 
each variable in an attempt to gauge the importance of each specific variable. ISLLC Standard I, Function A 
states, “Collaboratively develop and implement a shared vision and mission” (Council of Chief State School 
Officers, 2007, p.l); this function then served as the basis for two survey items - 1) Collaboratively develop a 
shared vision and/or mission; and 2) Collaboratively implement a shared vision and/or mission. The survey 
items themselves were preceded by the general statement, “A principal should be able to...” 

The 66-item multiple choice questionnaire was a series of “forced response” questions that reflected a 
range from 4 - essential to 1 - insignificant, concerning the level of importance a particular ISLLC function 
serves when developing a summative evaluation for building principals. The range of total response scores 
could then be scaled from 66 (implying that all of the ISLLC 2008 functions are insignificant when developing 
a summative evaluation for building principals ) to 264 (implying that all of the ISLLC 2008 functions are 
essential when developing a summative evaluation for building principals). Part B of the on-line survey 
consisted of a series of basic demographic informational questions related to the participant’s particular 
working environment. 

Population Surveyed 

The subjects for this research design came from a convenience sample of New Jersey School Superinten¬ 
dents, also identified as Chief School Administrators and henceforth referred to as CSAs, from the current 
population of approximately 612 CSAs in the State of New Jersey. Since an on-line survey tool was used to 
collect data, an e-mail list was developed from the New Jersey Association of School Administrators 2008 
Membership Directory and Buying Guide (NJASA, 2008) for all currently registered NJASA members, of 
which there are approximately 525. An initial correspondence eliciting participation in the research was 
blanket e-mailed to this list of electronic addresses on June 2, 2008. Contained in the soliciting e-mail memo 
was an explanation of the research along with a link to the survey site. Upon the initial mailing, approx¬ 
imately 50 responses were returned indicating a “failure to deliver” message. This resulted in the initial 
e-mail being received by approximately 475 NJASA member e-mail addresses. A second e-mail correspon¬ 
dence containing a shorter message was forwarded two weeks later. On July 18, 2008, the on-line survey 
site was deactivated and all completed surveys tallied. Fifty-two participants completed the survey for a 
response rate of approximately 11%. 

In the State of New Jersey, school districts are categorized as either urban or suburban with a special 
classification of “Abbott” for those districts that meet specific criteria for a percentage of the population 
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that are identified as low income. School districts classified as “Abbott” districts are provided with extra 
state funding to supplement educational programs due to a lack of financial equity when compared to the 
state’s more affluent districts. These school districts generally have the largest educational, community and 
social problems to surmount. Of the CSAs involved in this study, none from “Abbott” classified districts 
responded. The majority of the participants, 92%, were from suburban school districts, 4% were from urban 
districts and 4% of the respondents did not identify his district type. 

The State of New Jersey uses an additional coding structure to determine and classify each school district’s 
financial potential, defined as “District Factor Group” or DFG. Based on this specific coding it was determined 
that 25% of the survey respondents are currently CSAs in what would be considered affluent/wealthy school 
districts, 12% from upper middle class school districts, 12% from average middle to lower middle class (blue 
collar) school districts and the remaining 51% were equally distributed among the other 10 DFG factor 
ratings. 

3 Results and Discussion 

Demographic Findings 

Regrettably, only 52 current working CSAs participated in this research study from a potential popu¬ 
lation of approximately 475. As had been mentioned previously, this accounted for approximately an 11%) 
participation rate. This low participation rate can be attributed to three potential explanations. 

First, the initial participation e-mail was distributed in early June, a busy time of the academic year, 
considering that most districts in the State of New Jersey are gearing up for the close of the official school 
year. The follow-up e-mail came two weeks later and conditions would not have changed much; in fact, they 
most likely grew more hectic. 

Second, many school districts now employ filtering software as a security method to protect student and 
staff populations from receiving unwarranted solicitation from private web addresses and/or to guard against 
student and staff users from accessing unwanted websites. This fact alone could have eradicated numerous 
e-mail deliveries to potential participants without the researcher being made aware. 

Finally, the low participation rate could also speak to the overwhelming nature of the job of the superin¬ 
tendent. Many CSAs are so busy with the daily operations and responsibilities of running a school district 
that participation in any research project is a luxury not afforded them because of the massive demand on 
their time. 

Although more males (34) participated in the study than females (18), 65% and 35% respectively, this 
represented a more equitable breakdown by gender than is currently represented in the State of New Jersey. 
Currently, females represent 22% of the state’s superintendents while males represent 78% (Edmunds, 2007). 

A majority of the participants (64%) hold terminal degrees and the majority (50%) have 6-10 years 
of classroom experience. Additionally, 54% claimed 21 or more years of administrative experience. Coupled 
with the fact that 82% served as a building principal at one time or another during their administrative 
career, this sample, although small, could be considered a well seasoned and experienced field of public 
school administrators. 

One delimitation, however, to inferring the survey results to the at-large population of CSAs is that a 
majority of the respondents came from average to above average middle class, suburban school communities, 
as was previously mentioned under Population Surveyed. A representative sample of respondents from urban 
and inner city school districts was negligible. This limits the possible conclusions and implications that can 
be drawn with regard to the evaluation of New Jersey school building principals from the results of this 
survey to primarily average, middle class suburban school environments. 

Survey Findings 

The purpose of the survey, and this project in general, was twofold - to acquire a sense of what is important 
to the evaluation process of New Jersey public school building principals as perceived by their administrative 
superiors using the ISLLC standards as the operative content model; and to attempt to distinguish between 
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what are the essential, as opposed to the important, leadership functions and job responsibilities of a building 
principal as defined by the ISLLC standards and determined by New Jersey Chief School Administrators 
through the summative evaluation process. However, since a majority of responses were from suburban chief 
school administrators, all results and potential conclusions can only be inferred to school building principals 
employed in suburban school districts. 

A cursory review of participant responses indicated that all of the standards and their respective functions 
are considered “essential” or “important” to CSAs when developing summative evaluations for their district’s 
principals. In fact, the total mean score for all survey questions was 223 with a standard deviation of 
19.29. Since a survey total score of 264 indicates a selection of “essential” for each survey item, the mean 
score obtained indicates that all respondents believed these functions to be important when developing a 
principal’s summative evaluation. 

Responses to the survey questions obtained median scores ranging from 4.00 to 3.00 and standard devi¬ 
ations ranging from .19 and .75. This relatively small degree of variability indicates that the median scores 
are a strong and reliable indicator of central tendency (Witte & Witte, 2007). 

These previously identified quantitative observations suggest a level of operational credibility for each of 
the ISLLC standards and their subsequent functions. Upon closer review, however, some of the standards 
and their respective functions appeared to be more important than others. 

The footprint for ISLLC Standard 1 is: An education leader promotes the success of every student by 
facilitating the development, articulation, implementation, and stewardship of a vision of learning that is 
shared and supported by all stakeholders (CCSSO, 2007). Seventy-seven per cent of the respondents believed 
that the element of function 1A which requires building leaders to collaboratively implement a shared vision 
and mission (CCSSO, 2007, p.l) is essential. That aspect of function 1C which states, create and implement 
plans to achieve goals (CCSSO, 2007, p.l), is believed to be an important skill a principal needs to be able to 
implement in his/her respective school community by 81% of the respondents. Conversely, only 529? of the 
respondents believe that the ability to promote organizational learning (CCSSO, 2007, p.l), a component of 
function 1C, is an essential function of the building principal. These results suggest that suburban CSAs not 
only place an importance on vision but the implementation and realization of that vision by their district’s 
principals. 

The footprint for ISLLC Standard 2 is: An education leader promotes the success of every student 
by advocating, nurturing, and sustaining a school culture and instructional program conducive to student 
learning and staff professional growth (CCSSO, 2007). Function 2D, the capacity to supervise instruction 
(CCSSO, 2007, p.2) is considered by 73% of suburban CSAs to be an essential part of the principalship. 
Inherent to this task are those aspects of function 2A which addresses the principals’ abilities to nurture 
and sustain a culture of trust (CCSSO, 2007, p.2), which 77% of the participants rated as essential and 
to nurture and sustain a culture of learning and high expectations (CCSSO, 2007, p.2), which 73% of the 
respondents believed essential. Additionally, the response rate for function 2H, which speaks directly to 
the use of technology in the classroom, was somewhat surprising. Only 31% of the respondents thought 
it essential that principals promote the use of the most effective and appropriate technologies to support 
teaching (CCSSO, 2007, p.2). 

The footprint for ISLLC Standard 3 is: An education leader promotes the success of every student by 
ensuring management of the organization, operation, and resources for a safe, efficient, and effective learning 
environment (CCSSO, 2007). As might be expected, function 3C, which directly responds to the safety and 
welfare of both students and staff, was by far what suburban CSAs considered to be the most essential task a 
principal needs to be able to accomplish and sustain. Ninety-six percent of the respondents believe that the 
principals’ ability to promote and protect the welfare and safety of students (CCSSO, 2007, p.3) is essential 
and 90% felt similarly about the safety of the staff. Conversely, evaluating the management and operational 
systems (CCSSO, 2007, p.3) an aspect of function 3A, is considered to be the least essential skill, as only 
19 % rated this skill as essential. This is a curious juxtaposition of values that might be better explained 
through a qualitative approach. 

The footprint for ISLLC Standard 4 is: An education leader promotes the success of every student 
by collaborating with faculty and community members, responding to diverse community interests and 
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needs, and mobilizing community resources (CCSSO, 2007). Beginning with this standard the variability 
in participants’ responses concerning specific functions starts to increase. The ability to clearly delineate 
essential functions becomes more difficult. This quite possibly suggests the influence of the political climate 
and community environment of the respondents. 

The aspect of function 4C which asks principals to build positive relationships with families and caregivers 
(CCSSO, 2007, p.4) garnered 61% of the essential response rating, indicating that the principals’ capability 
to build positive family relationships is an essential skill that needs to be addressed. The facility to sustain 
positive relationships with families and caregivers (CCSSO, 2007, p.4) is considered essential by 56% of 
the respondents. The ability to promote understanding, appreciation, and use of the community’s diverse 
intellectual resources (CCSSO, 2007, p.4), a facet of function 4B, is only considered essential by 19% of the 
participants. 

The footprint for ISLLC Standard 5 is: An education leader promotes the success of every student 
by acting with integrity, fairness, and in an ethical manner (CCSSO, 2007). Analysis of the participants’ 
individual responses reveals a level of variability which is quite large. However, that aspect of function 5B 
which addresses the principals’ aptitude to model principles of ethical behavior (CCSSO, 2007, p. 5) stands 
out as the most essential characteristic a CSA wants to witness in their principals. Since this function is 
at the core of ISLLC Standard 5 it is no surprise that 79% of suburban CSAs thought this to be essential. 
Coming in a distant second was that aspect of function 5D which asks principals to consider the potential 
legal consequences of decision making (CCSSO, 2007, p. 5). Sixty percent of the respondents thought this 
to be an essential skill. Interesting to note is that this function specifically addresses the legal aspects of a 
principal’s decisions. This might suggest a regional phenomenon considering that the State of New Jersey is 
perceived by many, including those who reside within it, as overly litigious. 

The footprint for ISLLC Standard 6 is: An education leader promotes the success of every student by 
understanding, responding to, and influencing the political, social, economic, legal, and cultural context 
(CCSSO, 2007). A principal’s capability to be an advocate for children (CCSSO, 2007, p. 5), a component 
of function 6A, acquired a rating of “essential” by 87% of the participants. However, the capacity to act to 
influence state and/or national decisions affecting student learning (CCSSO, 2007, p. 6), an aspect of function 
6B, obtained a rating of “essential” by only 4% of the respondents. In fact, 46% of the respondents felt this 
skill to be only somewhat important to insignificant. These results seem to suggest that the principal’s 
talent for influencing both state and national decisions concerning student learning is not considered that 
important by suburban CSAs when evaluating principals. 

In an effort to synthesize and consolidate those functions deemed to be most important or “essential” 
to the evaluation of suburban New Jersey building principals as perceived by suburban CSAs, Table 1 was 
constructed. Table 1 lists each “essential” function and its corresponding ISLLC Standard footprint in rank 
order to outline a better visual representation of what current suburban New Jersey principals need to be 
sure to address in fulfilling their obligations and responsibilities as a building leader. 

4 

E - Essential (4); I - Important (3); SI - Somewhat Important (2); IN - Insignificant (1) 
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Rank Order of the Essential ISLLC Standard Functions 



Survey 

Item 

ISLLC 
Stan¬ 
dard & 
Func¬ 
tion 

E 

I 

SI 

IN 

m* 

Median 

SD 

32 

Promote 

and 

protect 

the 

welfare 
and 
safety 
of stu¬ 
dents 

III - 3c 

96% 

4% 

0% 

0% 

0% 

4.00 

.194 

33 

Promote 

and 

protect 

the 

welfare 
and 
safety 
of staff 

III - 3c 

90% 

8% 

0% 

0% 

2% 

4.00 

.379 

61 

Be an 

advo¬ 
cate for 
chil¬ 
dren 

VI - 6a 

87% 

13% 

0% 

0% 

0% 

4.00 

.345 

7 

Implemer 
a plan 
to 

achieve 

the 

school’s 

goals 

itl - lc 

81% 

19% 

0% 

0% 

0% 

4.00 

.397 

continued on next page 
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Model V - 5b 
princi¬ 
ples of 
ethical 
behav- 


CollaborcAlvelJa 
imple¬ 
ment a 
shared 
vision 
and/or 
mission 

Nurture II - 2a 
and 
sustain 
a cul¬ 
ture of 
trust 

Nurture II - 2a 
and 
sustain 
a cul¬ 
ture of 
learn¬ 
ing_ 

Supervise II - 2d 
Instruc¬ 
tion 

Nurture II - 2a 
and 
sustain 
a cul¬ 
ture of 
high 
expec¬ 
tations 


17% 4% 0% 0% 



21 % 0 % 0 % 2 % 



21 % 2 % 0 % 0 % 



25% 2 & 0% 0% 



25% 2% 0% 0% 


21% 4% 0% 2% 
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44 

Build 

positive 

rela¬ 

tion¬ 

ships 

with 

families 

and 

care¬ 

givers 

IV - 4c 

61% 

37% 

2% 

0% 

0% 

4.00 

.533 

57 

Consider 
the po¬ 
tential 
legal 

conse¬ 

quences 

of 

decision¬ 

making 

V - 5d 

60% 

36% 

2% 

0% 

2% 

4.00 

.536 

45 

Sustain 

positive 

rela¬ 

tion¬ 

ships 

with 

families 

and 

care¬ 

givers 

IV - 4c 

56% 

38% 

4% 

0% 

2% 

4.00 

.578 


Table 1 


(*m = percentage of missing responses) 

The results outlined in Table 1 suggest that safety, child advocacy, strategic planning, ethical behavior, 
collaboration, trust building, nurturing learning and instruction, sustaining high expectations, maintaining 
and sustaining family relationships and understanding the legal aspects of decision making are the primary 
essential elements that need to be adequately addressed by suburban building principals in the State of New 
Jersey in order to be considered successful by their respective CSAs. 

This is a daunting list to be sure, however, an immediately more workable list of criteria than might 
be previously anticipated. Undeniably, all of the new functions for the ISLLC 2008 Standards are essential 
for the success of every educational community, but identification and prioritizing what could be considered 
the most essential is important for the continued development and success of every new and young principal 
(Crow, 2006; Davis & Hensley, 2000; Waters & Kingston, 2005). 

5 Conclusions 

The list of prioritized ISLLC functions in Table 1 suggests that current New Jersey suburban CSAs might 
rank order the ISLLC Standard’s footprints in the following manner: 

1. An educational leader should promote the success of every student by ensuring management of the 
organization, operation, and resources for a safe, efficient, and effective learning environment (Standard 

III). 
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2. An educational leader should promote the success of every student by understanding, responding to, 
and influencing the political, social, economic, legal, and cultural context (Standard VI). 

3. An educational leader should promote the success of every student by facilitating the development, 
articulation, implementation, and stewardship of a vision of learning that is shared and supported by 
all stakeholders (Standard I). 

4. An educational leader should promote the success of every student by acting with integrity, fairness, 
and in an ethical manner (Standard V). 

5. An educational leader should promote the success of every student by advocating, nurturing, and sus¬ 
taining a school culture and instructional program conducive to student learning and staff professional 
growth (Standard II). 

6. An educational leader should promote the success of every student by collaborating with faculty and 
community members, responding to diverse community interests and needs, and mobilizing community 
resources (Standard IV). 

This prioritized ranking of the ISLLC Standard footprints based on each standard’s ranking of essential 
functions is an interesting point of departure from the current discussion in the field, which implies that a 
principal’s primary focus should be on classroom instruction. ISLLC Standard II, which directly responds 
to this responsibility, is rated fifth out of a list of six. This is an unusual circumstance considering current 
thought in this age of student achievement and accountability as it relates to the principal as an instructional 
leader (Quinn, 2002). 

When one looks at this ranking in a holistic sense one sees a theme that emerges where, not surprisingly, 
student wellness and advocacy are the priority. This has been a time honored tradition and expectation of 
the principalship since its inception. Second to these time-honored responsibilities is the principal’s ability 
to set a clear vision and path for everyone in the educational community and to act in an ethical manner. 
The role of instructional leader and collegial facilitator are ranked surprisingly at the bottom of this list. 
This is not to imply that these functions are not important elements associated with the principalship but 
possibly not as important to current suburban CSAs as one might be led to think based on current thought 
in the field. 

It could be surmised that current suburban CSAs, at least in New Jersey, are quite possibly holding 
school building principals to the same set of standards on their summative evaluations that they themselves 
were held to when they were site administrators. Since the field of administrator preparation is so focused 
on the ISLLC standards, understanding how our graduates are going to be evaluated in the field in relation 
to these standards could quite possibly assist administrator preparation programs to more comprehensively 
prepare students for the realities of the practice in the real world of work. 
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